The proposed class action alleges Meta illegally harvested people's Facebook and Instagram photos to train its AI image-generation models and to build its unreleased "NameTag" face recognition feature. A set of parents and their children in Illinois and California filed a lawsuit last week in federal court in Chicago alleging that Meta illegally used their Facebook and Instagram photos to build NameTag, an unreleased face-recognition system for its smart glasses, and to train generative AI models including Emu and Muse Image . The proposed class action alleges that Meta violated Illinois and California privacy laws by extracting biometric information from people's photos without notice or consent. WIRED reported in June that code for NameTag had been secretly embedded in the Meta glasses AI companion app, which had been downloaded more than 50 million times. While the feature had not been enabled for users of the app, the analysis found that the system was designed to turn faces captured by the glasses into biometric signatures and compare them with so-called faceprints stored in a database on the user's phone.

Since WIRED reported on Meta's NameTag face recognition system, company executives have made confusing and conflicting remarks about its very existence. Does a software feature exist if its code has been deployed to the devices of millions of people but they can't use it yet? Not if you work at Meta . The company's executives have spent the last few weeks making this semantic argument about NameTag, the in-development face-recognition system that Meta built for its smart glasses . The inevitable result is confusion, but that's easy enough to clear up.

Rank One, whose board includes a former CIA deputy director and a former FBI science chief, supplied face recognition to Meta for internal development of its smart glasses app. Meta is testing face-recognition software built by a company that sells surveillance tools to police departments and the United States military, as it explores bringing the technology to its smart glasses, WIRED has learned. The arrangement is documented in a software license, obtained by WIRED, that was issued by Rank One Computing--a Denver-based company that derives roughly 80 percent of its revenue from government clients--and is tied to a test version of the Meta AI app that powers Meta's Ray-Ban and Oakley smart glasses . Rank One's face recognition has been bought by the US Marshals Service, which uses it to confirm prisoners' identities without fingerprinting them during transport, and by the Naval Criminal Investigative Service--the Navy's police force--which purchased the company's video tool, ROC Watch. Rank One developed long-range face recognition for US Special Operations Command under a government research contract, saying its software could identify a face from as far as a kilometer away.

Facebook said it will shut down its face-recognition system and delete the faceprints of more than 1 billion people. "This change will represent one of the largest shifts in facial recognition usage in the technology's history," said a blog post Tuesday from Jerome Pesenti, vice president of artificial intelligence for Facebook's new parent company, Meta. "More than a third of Facebook's daily active users have opted in to our Face Recognition setting and are able to be recognized, and its removal will result in the deletion of more than a billion people's individual facial recognition templates." He said the company was trying to weigh the positive use cases for the technology "against growing societal concerns, especially as regulators have yet to provide clear rules." More than a third of Facebook's daily active users have opted in to have their faces recognized by the social network's system.

Several pieces of work have uncovered performance disparities by conducting "disaggregated evaluations" of AI systems. We build on these efforts by focusing on the choices that must be made when designing a disaggregated evaluation, as well as some of the key considerations that underlie these design choices and the tradeoffs between these considerations. We argue that a deeper understanding of the choices, considerations, and tradeoffs involved in designing disaggregated evaluations will better enable researchers, practitioners, and the public to understand the ways in which AI systems may be underperforming for particular groups of people.

In September 2019, the National Institute of Standards and Technology issued its first-ever warning for an attack on a commercial artificial intelligence algorithm. Security researchers had devised a way to attack a Proofpoint product that uses machine learning to identify spam emails. The system produced email headers that included a "score" of how likely a message was to be spam. But analyzing these scores, along with the contents of messages, made it possible to build a clone of the machine-learning model and craft spam messages that evaded detection. The vulnerability notice may be the first of many.